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Efficient and Effective Volume Visualization with 
Enhanced Isosurface Rendering 
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1 Abstract 



Compared with full volume rendering, isosurface rendering has 
several well recognized advantages in efficiency and accuracy. 
However, standard isosurface rendering has some limitations in ef- 
fectiveness. First, it uses a monotone colored approach and can 
only visualize the geometry features of an isosurface. The lack 
of the capability to illustrate the material property and the inter- 
nal structures behind an isosurface has been a big limitation of this 
method in applications. Another limitation of isosurface rendering 
is the difficulty to reveal physically meaningful structures, which 
are hidden in one or multiple isosurfaces. As such, the applica- 
tion requirements of extract and recombine structures of interest 
can not be implemented effectively with isosurface rendering. In 
this work, we develop an enhanced isosurface rendering technique 
to improve the effectiveness while maintaining the performance ef- 
ficiency of the standard isosurface rendering. First, an isosurface 
color enhancement method is proposed to illustrate the neighbor- 
hood density and to reveal some of the internal structures. Second, 
we extend the structure extraction capability of isosurface render- 
ing by enabling explicit scene exploration within a 3D-view, us- 
ing surface peeling, voxel-selecting, isosurface segmentation, and 
multi- surface- structure visualization. Our experiments show that 
the color enhancement not only improves the visual fidelity of the 
rendering, but also reveals the internal structures without signifi- 
cant increase of the computational cost. Explicit scene exploration 
is also demonstrated as a powerful tool in some application scenar- 
ios, such as displaying multiple abdominal organs. 



CR Categories: 1.3.3 [Computer Graphics]: Picture/Image 
Generation — Display algorithms; 1.3.7 [Computer Graphics]: 
Three-Dimensional Graphics and Realism — Color, shading, shad- 
owing, and texture 

Keywords: isosurfaces, volume rendering, transfer-functions, 
GPU ray-casting 

1 Introduction 

Isosurface rendering is one of the canonical techniques used for 
volume visualization. Compared with other visualization methods, 
ray-cast based isosurface rendering has several widely acknowl- 
edged advantages in efficiency and accuracy. For example, the ray- 
isosurface intersection test can be very efficiently and accurately 
performed at the voxel level for each viewing ray. The empty space 
skipping techniques can also be intuitively implemented and yield 
very good performance. In comparison, some other volume render- 
ing techniques such as semi-transparent rendering, also called full 
volume rendering, needs to take many samples in the volume, and 
involves intensive calculation. Although empty space skipping is 
also possible for the full volume rendering, the performance gain is 
relatively limited compared with isosurface rendering. 

The standard isosurface rendering, however, also has some limita- 
tions in effectiveness. First, the isosurface rendering usually assigns 
a monotone color to an isosurface as the material color. Therefore, 
only the geometry properties of the isosurface can be visualized 
with shading. On the other hand, as we have noticed, full volume 
rendering is also capable of rendering isosurfaces, which can be 




Figure 1: Comparison of isosurface rendering and full volume ren- 
dering of the same isosurface. (a) Isosurface rendering, (b) full 
volume rendering. 



54 done by using a transfer-function with a narrow transitional section. 

55 Visualizations achieved using such rendering setting can provide 

56 considerably more information about the neighborhood density, as 

57 shown in Figure 1 . In many applications, it can be significantly ben- 

58 eficial to visualize the internal structures behind an isosurface. For 

59 example, in CT colonography, clinicians want to identify the na- 
eo ture of polyps. But from a monotone colored isosurface rendering, 

61 there's no information of the internal structure for decision mak- 

62 ing. To address this requirement, [Pickhardt 2004] conducted a full 

63 volume rendering with a selected window so that the internal struc- 

64 ture is revealed. However, additional computation is needed and the 

65 overall performance will be hurt. 

66 Another limitation of the isosurface rendering is the difficulty to 

67 identify structures of interest and to efficiently visualize multiple 
es structures of interests in a single view. Usually, an isosurface con- 

69 tains many different physically meaningful structures, and the users 

70 are interested with a few of them. The rest of the structures, as they 

71 are connected as a whole, are not only unnecessary, but also visually 

72 confusing. To tackle this problem, segmentation can be considered. 

73 However, direct volume segmentation methods usually do not inte- 

74 grate very well with isosurface rendering, and artifacts are likely to 

75 be introduced. 

76 In this work, we develop an enhanced isosurface rendering tech- 

77 nique to improve the effectiveness while maintaining the perfor- 

78 mance efficiency of the standard isosurface rendering. First, we 

79 propose an isosurface color enhancement method to illustrate the 
so material property and the internal structures behind the isosurface. 
si Our approach considers the neighborhood volume directly behind 

82 the isosurface, and applies this information to derive the property 

83 of local material varying along the isosurface. Since it is a col- 

84 oring/shading method, the voxel-traversal and ray-voxel intersec- 

85 tion scheme is not changed from the original isosurface rendering, 
se Therefore the simplicity of the standard isosurface rendering is kept 
87 the same, and computational complexity of the enhanced isosurface 
ss rendering is not increased. Second, we enhance the structure extrac- 

89 tion capability of isosurface rendering by enabling explicit scene ex- 

90 ploration within a 3D-view, using surface peeling, voxel- selecting, 

91 isosurface segmentation, and multi- structure visualization. During 

92 this process, different structures can be extracted from different iso- 
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93 surfaces intuitively. Then, the surface structures are recombined 

94 into a single scene for display. The segmentation and recombina- 

95 tion is done within the subset of the voxels that contain the required 

96 isosurface, so the segmentation result is very suitable to be inte- 

97 grated with the isosurface rendering scheme. 

98 The remainder of this paper is organized as follow. In Section 2, 

99 we introduce the related works in volume rendering. In Section 3, 

100 we provide an overview of our proposed approach. In Section 4, 

101 we describe the model and implementation of the isosurface color 

102 enhancement. In Section 5, we illustrate the techniques used in 

103 the explicit scene exploration framework. The experiment results 

104 are discussed In Section 6. In Section 7, we discuss some related 

105 issues and the future development of this work. 

06 2 Related Work 

10? 2.1 Isosurface Rendering 

108 Isosurface rendering has been intensively studied over the years, 

109 and many techniques has been developed which makes isosurface 
no rendering a highly efficient and accurate approach for volume vi- 
in sualization. To identify the intersection of a viewing ray and an 

112 implicitly defined isosurface in a volume, two techniques are in- 

113 volved. One is ray traversal, the other is intersection test. 

114 For ray traversal, two typical schemes are uniform sampling and 

115 voxel oriented traversal. Uniform sampling is more widely used in 
1 1 e GPU based volume ray-casting [Stegmaier et al. 2005] , and it is pre- 
117 ferred when used along with some algorithms like pre-integration 
us [Engel et al. 2001][Lum et al. 2004]. On the other hand, voxel ori- 

119 ented traversal provides an opportunity to do a precise intersection 

120 test. In earlier volume ray-casting techniques designed for CPU, 

121 the 3DDDA algorithm [Amanatides and Woo 1987] is often used, 

122 such as in [Parker et al. 1998]. 

123 There are also a couple of ways to perform the intersection test. The 

124 simplest way is to base on a linear approximation between samples. 

125 An equivalent method is to use a pre-integration. In voxel oriented 

126 ray traversal schemes, if tri-linear interpolation is used, the value 

127 along the ray segment within a voxel can be considered as a cubic 

128 function, the intersection test is converted to a cubic equation prob- 

129 lem, which can be solved in a closed form [Parker et al. 1998] or us- 

130 ing piecewise recursive root finding [Marmitt et al. 2004]. Approx- 

131 imate methods can provide a faster but inaccurate result as is given 

132 in [Neubauer et al. 2002] and Scharsach2005[Scharsach 2005]. 

133 When GPU is used, tri-linear interpolation is supported by the hard- 

134 ware. In that case, performance can be further improved by fetching 

135 fewer samples. In [Ament et al. 2010], it is pointed out that as few 

136 as 4 data fetches per voxel is enough for the coefficient extraction. 

137 In this work, we applied a similar strategy for the ray-isosurface 

138 intersection test. 

139 2.2 Full Volume Rendering 

140 The core concept of full volume rendering is volume rendering in- 

141 tegral, which is based on an optical model described in Max [Max 

142 1995] The integration is performed for a viewing ray cast from the 

143 viewpoint, where / = 0, to the far end, where / = Far. Iq is 

144 the light coming from the background, ji is the per-unit-length ex- 

145 tinction coefficient, and c is a intensity or color. In this paper, the 

146 neighborhood of the isosurface to be rendered is considered in this 

147 model. 



I = Io exp ^- J o Far fi (I) dfj 

+ / Far c(/) M (/)exp (-/ Z M (t)dt) dl 

us To distinguish different contents in a volume dataset during ren- 

149 dering, classification and segmentation are two commonly used 

150 technologies. Classification can be done by a variety of differ- 

151 ent transfer-functions, which are different from each other mainly 

152 in the feature domains where they are defined. While the most 

153 commonly used transfer-function is the intensity base lD-transfer- 

154 function, there are loads of other transfer-functions which are based 

155 on other features such as gradient magnitude [Kniss et al. 2002], 

156 size feature [Correa and Ma 2008], and texture feature [Caban and 

157 Rheingans 2008]. Although efforts have been made, classification 

158 based methods are just partially capable of the content distinguishi- 
ng ing task. Sometimes, segmentation is necessary. As another inten- 

160 sively studied area, most segmentation methods are not specifically 

161 designed for visualization, and the integration of segmentation re- 

162 suits and volume ray-casting has been problematic. 

163 To visualize a segmented volume, different transfer functions can 

164 be assigned to different segments of the volume. An issue has to be 

165 dealt with is the boundary filtering. On vector GPUs, a solution is 

166 given in [Hadwiger et al. 2003]. However, most recent GPUs use 

167 scalar architecture for better programmability, in which case, an- 

168 other solution given in [Xiang et al. 2010] is more suitable. In this 

169 work, instead of volume segmentation, we use isosurface segmenta- 

170 tion, which works on the subset of voxels containing the isosurface. 

71 2.3 Min-Cut Algorithm 

172 Many segmentation issues can be converted into a min-cut question 

173 in graph theory. The optimization method described by [Boykov 

174 and Kolmogorov 2004] provides a very efficient tool to deal with 

175 this kind of questions. In our work, we define the isosurface seg- 

176 mentation as a min-cut problem and use this algorithm for the opti- 

177 mization. 

178 3 Overview 

179 In this section, we provide an overview of our approach, as is shown 

180 in Figure 2, mainly focusing on the contributions of this work. 

181 The first contribution, the color enhancement technique, aims to 

182 visualize the neighborhood density and reveal the internal structures 

183 behind the isosurface. The technique is applied to each of the inter- 

184 section points on the isosurface to provide a material color. Our sec- 

185 ond contribution, the explicit scene exploration scheme is a com- 

186 position of several novel techniques aiming to enhance the struc- 

187 ture extraction capability of isosurface rendering. When provided 

188 with a volume dataset which we have little knowledge, cropping 

189 and surface peeling can be used for a brief exploration so that the 

190 structures of interest can be quickly identified. Then, using the iso- 

191 surface segmentation, the structures of interest can be extracted and 

192 represented as isosurface segments. With a slightly modified iso- 

193 surface intersection search procedure along with the color enhance- 

194 ment technique, the isosurface segments can be rendered within a 

195 single scene, which we call the multi-surface-structure visualiza- 

196 tion. During the isosurface segmentation, a few seed voxels are 

197 specified by the user. An intuitive seed selecting interface is de- 

198 signed to handle this task, which involves two techniques: voxel 

199 selecting and selection based coloring. While in voxel selecting, 

200 seed points are collected by user's mouse clicks and drags on the 

201 image plane. The selection based coloring provides a preview of 
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Figure 2: The overview of the contributions of our approach. The proposed enhanced isosurface rendering technique is accomplished by the 
color enhancement method and the explicit scene exploration scheme. Explicit scene exploration consists of surface peeling, voxel-selecting, 
isosurface segmentation, and multi-surface-structure visualization. 



these seeds. The interaction process works directly in a 3D view, 
that's why we call it "explicit scene exploration". During this pro- 
cess, the voxel based ray-traversal and ray-isosurface intersection 
search is an essential part of the system, which yields an accurate 
ray-isosurface intersection for each ray. The IDs of the voxels con- 
taining the intersection points are also collected in this process. 

4 Color Enhancement 

Traditional isosurface rendering usually assigns a monotone color 
to an isosurface as the material color. The reason is that every point 
belonging to an isosurface has the same scalar value. Since the 
only scalar value is used for defining the geometry of the structure, 
there's no information directly available to define the material of 
that surface. However, if we consider a small neighborhood directly 
behind the isosurface, it is possible to get some information of the 
of local material varying along the isosurface. 

4.1 Visualization Model 

Inspired by full volume rendering, we consider the isosurface 
neighborhood to be semi-transparent. In full volume rendering, 
such a neighborhood can be defined by a transfer-function in which 
the opacity transits from to 1 within a narrow range near the iso- 
value. As shown in Figure 3, such a transitional section can be 
specified by an isovalue and a local transfer function. The transi- 
tional section ranges from isovalue to isovalue + A v. Scalar val- 
ues less than isovalue are mapped to fully transparent, and scalar 
values greater than isovalue + Av are mapped to fully opaque. 

If the neighborhood of the isosurface corresponding to Av is suffi- 
ciently thin, it can be assumed that most of the viewing rays hitting 
the isosurface are going through the whole transitional range and 
the alpha value finally accumulates to 1. In this case, the accumu- 
lated color is mainly decided by the thickness of the neighborhood 
Al where the accumulation happens. If Al is relatively big, the 
color of the nearer neighborhood plays an important role, and the 
contribution of the farther neighborhood is relatively small since 
the opacity accumulates. Reversely, if Al is small, the color of the 
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Figure 3: Transfer-function defined by a single transitional section 




Figure 4: Linear Approximation of the Isovalue Neighborhood, 
denotes the length of ray. v denotes the scalar value. 



236 farther neighborhood will count more. 

237 From the intuitive observation, we consider to use the scalar chang- 

238 ing rate (or directional derivative) as a local material hint, since Al 
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can be linearly approximated by dividing the value range Av by the 
directional derivative. 

However, let's still begin with Al, because it is directly related to 
the alpha values used for accumulation in full volume rendering. In 
full volume rendering, if n scalar values are evenly sampled within 
the isosurface neighborhood of thickness Al, the alpha value of a 
sample used for accumulation can be calculated as: 



q, CXjp stdS ampleDistance 

246 , where olt denotes the alpha value defined in the transfer-function 

247 assuming a sample distance stdS ampleDistance. With linear ap- 

248 proximation, there is: 



Al 



Av 

v'l(liso) 



249 , where v'i (h so ) denotes the scalar changing rate at the intersection 

250 point. So: 



a ~ OLT 



stdSampleDista 



v'l(kso) 



(1) 



251 Now, we define: 



densityF actor 



Av 



speed - 



v ' jXhso) 

density Factor 



stdS ample Distance 



speed G (0, +oo) 



252 In this way, Equation (1) can be writen as: a 

253 From the above formulations, we know that: 



Q^ijp ra-speed 



254 • A value speed can be easily calculated from the scalar 

255 changing rate at the intersection point, v\ (hso), with 

256 density Factor as a global tunable parameter. 

257 • Given the value speed, the alpha values used for accumulation 

258 can be approximated. 

259 4.2 Speed-color Map 

260 During rendering, we use v\ (hso) to characterize the local mate- 

261 rial. To efficiently calculate the material color from the v i (h so ), a 

262 map from speed to color C is built as follow: 

263 Given a local transfer-function 

{cm, Ci = (ri,gi,bi) ,i = 1, 2, 3, n} 
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264 , for each speed, a spe ed,i = otTi n - s P eed . The accumulated color 

265 C (speed) can be pre-calculated by an alpha blending: 



C (speed) 



i=l 



x-speed 



n (i 



Otspeed,j ) 



3 = 1 



266 However, since speed has an infinite value range, we cannot 

267 simply build a speed-color map linearly. In our implementa- 

268 tion, we use a logarithm sampled speed-color map of size m, 

269 \Cj — C (— In (l — 3/ m ) ) , j = 1, 2, 3, • • • , m} to store the pre- 

270 calculated material colors. 
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(c) 



Figure 5: Displaying shallow and deep neighborhood with differ- 
ent estimations of the scalar changing rate, (a) Mono colored, (b) 
Displaying shallow neighborhood, estimated with the gradient vec- 
tor, (c) Displaying internal structures. 



4.3 Estimation of Scalar Changing Rate 

The scalar changing rate v i (h so ) can be estimated in different 
ways during rendering, which has a significant effect on the ren- 
dering result. For basic coloring need, we can simply use Vv • r, 
where Vv denotes the gradient vector, which will be calculated for 
shading anyway, and r is the direction vector of the viewing ray. In 
our implementation, Vv is calculated on the fly with 6 neighbor- 
ing scalar samples. However, using an estimation like this, only a 
shallow neighborhood behind the isosurface can be reflected by the 
resulted color, as Figure 5 (b) shows. 

To reveal the internal structures, scalar changing rate should be es- 
timated within a larger scope. To this end, we add in Av as another 
global tunable parameter. In scalar changing rate estimation, we 
first perform an iterative search along the viewing ray to find a Al 
where the scalar value reaches isovalue + Av. Then the scalar 
changing rate is estimated by Al/ Av. In this way, we find that 
many of the internal structures can be revealed without noticeable 
performance impact. Figure 5 (c) is an example, and more will be 
presented in the result part. 

5 Explicit Scene Exploration 

An innate advantage of isosurface rendering is that, for each ray, 
a definite intersection point can be generated. When voxel based 
ray-traversal is used, the exact voxel can also be identified. This 
feature can be very useful in interaction design. For example, it en- 
ables the direct picking of voxels from the volume by mouse click- 
ing and dragging within the 2D image plane. By exploiting this 
advantage, we develop an explicit scene exploration framework to 
quickly identify the structures of interest, pick them out, and re- 
combine them into a single scene. 

5.1 Accuracy Assurance 

To guarantee the quality of the interaction, such as the voxel select- 
ing operation, it is crucial to make sure that the ray-isosurface inter- 
section test is accurate for each ray. First, voxel based ray traversal 
such as the 3DDDA algorithm should be used. Second, the inter- 
section finding within the voxel should be accurately performed. 

When trilinear interpolation is assumed, the value along the ray seg- 
ment within each voxel can be expressed as a cubic function to the 
ray parameter. Once the coefficients of the cubic function are de- 
cided, the intersection test can be transformed into solving a cubic 
equation, which can be efficiently solved using the method pro- 
posed by Marmitt et al. [Marmitt et al. 2004]. There are different 
ways to decide the coefficients of the cubic function. We choose 
to use four values along the ray in each voxel to estimate the co- 
efficients of the cubic polynomial, as is shown in Figure 6. The 
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Figure 6: Use four values along the ray in each voxel to estimate 
the coefficients of the cubic polynomial. 





(b) 



Figure 7: Surface Peeling, (a) Illustration of surface peeling, (b) 
An example of surface peeling. 
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(a) 

Figure 8: Voxel Selection, (a) Illustration of the process of voxel 
selecting, (b) Illustration of a voxel ID buffer. 













Jt 






(7 




-® / 










































(a) 



(b) 



Figure 9: Isosurface Segmentation, (a) 2D illustration of is o sur- 
face segmentation, (b) Use the length of the intersection of isosur- 
face and voxel boundary as the weight. 



315 viewing ray enters the voxel from pO and exits from p3. A value 

316 is fetched at pO, pi, p2, and p3 each respectively, where pi and p2 

317 are the trisection points of the ray- voxel intersection. 

sis 5.2 Surface Peeling 

319 When provided with a volume data which we have little knowledge, 

320 the first issue of visualization should be to explore the dataset and 

321 identify the structures of interest. This has not been a simple issue 

322 for both full volume rendering and monotone isosurface rendering, 

323 due to the fact that many of the structures overlap each other. 

324 For isosurface rendering, we can use cropping and surface peeling 

325 for the brief exploration. Cropping is a simple technique which just 

326 trunk the volume with a bounding box during rendering to localize 

327 the rendering region of the volume. Surface peeling is performed by 

328 jumping over the first few intersection points within some selected 

329 image plane areas, so the the structures behind can be exposed. As 

330 is shown in Figure 7 (a), a peeling window is defined on the image 

331 plane. Within that window, the first ray-isosurface intersection is 

332 skipped over, so the second layer of the isosurface is rendered. In 

333 our implementation, we use an integer array as the "peeling buffer". 

334 The values are initialized as 0. Within each peeling window, the 

335 peeling value increases by 1. During rendering, the number of in- 

336 tersections is counted, if the count is no-bigger than the peeling 

337 value, the intersection will be skipped over. Figure 7 (b) gives an 

338 example of surface peeling, which contains two peeling windows. 

339 5.3 Voxel Selection 

340 As mentioned above, when ray traversal is done in a voxel-by-voxel 

341 manner and the intersections are accurately calculated, the exact in- 

342 tersecting voxel can be identified for each ray intersecting the iso- 

343 surface. As is shown in Figure 8 (a), a unique ID is assigned to 

344 each voxel in a sequential manner. Then, a voxel ID buffer is used 

345 to store the intersecting voxel IDs of each ray, which can be used 



346 for voxel selecting after the rendering. When user clicks or drags 

347 the mouse on the image plane, the corresponding voxel ID can be 

348 collected and organized. Figure 8 (b) illustrates a voxel ID buffer, 

349 where each small color patch is contained in a voxel. The color 

350 patches are neatly connected together due to accurate ray-isosurface 

351 intersection test. 

352 Voxel selection in a 3D view provides a intuitive and effective in- 

353 teraction tool, which we used for the seed selecting in isosurface 

354 segmentation. 

355 5.4 Isosurface Segmentation 

356 For some complicated medical datasets, segmentation is necessary 

357 for volume visualization. Traditionally, volume segmentation meth- 

358 ods are used as the preprocessing, through which a label volume 

359 is generated. Then, rendering is done by using different transfer- 

360 functions for different volume components. These methods usually 

361 have three drawbacks. First, the segmentation is usually performed 

362 in slice views or the intensity domain, which is not intuitive. Sec- 

363 ond, the label volume, in which the segmentation result is stored 

364 has very limited precision. Stair-case artifacts can be frequently 

365 seen in rendering. Third, volume segmentation itself can be very 

366 complicated and expensive in computation. 

367 In this part, we propose an isosurface domain segmentation method, 

368 in which we only consider the voxels containing the specific isosur- 

369 face. The idea is that, these voxels can be considered as forming 

370 an inter-connected network, using 6-neighborhood, as is shown in 

371 Figure 9 (a), where it is 4-neighborhood in 2D. So the isosurface 

372 segmentation can be considered as a graph segmentation problem. 

373 With the voxel selection method described above, the seed points 

374 for the foreground and the background can be directly picked from 

375 the rendering view. In our implementation, the voxel IDs of the seed 

376 points are stored as two "set" structures, which is sorted and opti- 

377 mized for searching. The graph is then constructed by a breadth 
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Figure 10: Multi-surface-structure visualization 



378 first search from both seed sets. In the graph, the segmentation 

379 problem can be defined as to find an optimal cut that separate the 

380 two seed sets, which can be solved with the min-cut algorithm after 

381 the weight of each link is decided. For the decision of the weights, 

382 it is intuitive to consider the geometrically shortest cut as the opti- 

383 mal solution, since it introduces the smallest damage to the original 

384 structure. So the weight should be defined as the length of the in- 

385 tersection of the isosurface and the voxel boundary, as is shown in 

386 Figure 9 (b), the A-B segment. 

387 If there is only one segment of intersection of the isosurface and the 

388 voxel boundary, the length can be simply calculated by a numerical 

389 integration. However, with trilinear interpolation in volume space, 

390 there can be as many as two segments at most, although such case 

391 is rare. In that case, usually only one of the two segments is of in- 

392 terest during segmentation, but there's no information about which 

393 segment it is. So we treat this case by dividing the total length of 

394 the two intersection segments by 2. 

395 During seed selection, the current selection status is previewed with 

396 a selection based coloring method. Since the seed sets are not likely 

397 to be large, they are directly transfered to the graphics memory 

398 as sequential lists. During rendering, for each intersection point, 

399 according the voxel ID information, it can be judged whether the 

400 voxel is contained in the two lists by binary searches, and the color 

401 can be decided accordingly. 

402 With isosurface segmentation, the IDs of two sets of voxels are ex- 

403 tracted, each containing part of the same isosurface, which we call 

404 surface structures. Such a surface structure is not guaranteed to 

405 be closed, so it cannot substitute volume segmentation. However, 

406 we will show that they can be recombined and rendered in a sin- 

407 gle scene with different coloring settings, which provides valuable 

408 visualization results. 

409 5.5 Multi-surface-structure Visualization 

410 To combine the surface structures into a single scene, a label vol- 

411 ume of 8-bit integer values, ranging from to 255 is used. While 

412 the value is used to mark the empty voxels, values from 1 to 255 

413 are corresponding to different surface structures. So at most 255 

414 surface structures are allowed to be defined, which is sufficient for 

415 most applications. For each surface structure, an isovalue is stored, 

416 which is the isovalue used in the isosurface segmentation stage to 

417 extract that surface structure. Also, to enable color enhancement, 

418 each surface structure has its own local transfer-function, and the 

419 speed-color maps are stored in a 2D look-up-table, where each line 

420 is corresponding to a speed-color map. 



Table 1: Performance Comparison of Full Volume Rendering 
(FVR) and Color Enhanced Isosurface Rendering ( CEIR) 



Dataset 


Volume Size 


Image Size 


Kernel Execution 
Time per Frame 


Mouse 


512 x 512 x 512 


765 x 592 


FVR: 60.6232 ms 
CEIR: 4.66121 ms 


Knee 


379 x 229 x 305 


589 x 488 


FVR: 46.4839 ms 
CEIR: 4.21262 ms 


Head 


208 x 256 x 225 


713 x 594 


FVR: 34.7136 ms 
CEIR: 4.06191 ms 



421 The rendering process is just slightly different from single isosur- 

422 face rendering. During ray traversal, the first step is to find a voxel 

423 with a none-zero label. Then, within the voxel, the isovalue corre- 

424 sponding to the label value is used for ray-isosurface intersection 

425 test, and the corresponding speed-color map is used for color en- 

426 hancement. Since the ray-isosurface intersection test can still be 

427 performed at subvoxel level, the accuracy is preserved and is free 

428 of the stair case artifacts. 

429 6 Results 

430 We conducted several experiments on the proposed techniques on 

431 a PC equipped with Intel i7 950 CPU, 4GB RAM, and NVIDIA 

432 Geforce GTX 480 graphics card. The rendering computation is im- 

433 plemented on the GPU with CUDA. 

434 6.1 Isosurface Color Enhancement 

435 As mentioned before, isosurface color enhancement can be used in 

436 two ways due to different methods of scalar changing rate estima- 

437 tion. Using shallow neighborhood approximation, enhanced iso- 

438 surface rendering can generate the rendering effect very similar to 

439 the full volume rendering that uses a transfer-function with a very 

440 narrow transitional section. As shown in Figure 1 1 , the visual ef- 

441 feet of color enhanced isosurface rendering is very close to the full 

442 volume rendering, while it only takes about 2.6 more milliseconds 

443 compared with monotone isosurface rendering. 

444 The capability to reveal internal structures can also be compared 

445 with full volume rendering. Figure 12 shows 3 examples of ren- 

446 dering the sample dataset with full volume rendering (FVR) and 

447 color enhance isosurface rendering (CEIR). Table 1 gives the per- 

448 formance comparison of FVR and CEIR. Using color enhanced iso- 

449 surface rendering, while the essential structures of interest behind 

450 an isosurface can be depicted in a similar way as full volume ren- 

451 dering, the computational cost remains at a very low level. 

452 6.2 Explicit Scene Exploration 

453 With the explicit scene exploration, a volume dataset can be ex- 

454 plored in an intuitive and efficient way. It includes several tech- 

455 niques. Within these techniques, surface peeling enables us to ex- 

456 plore structures deep inside the dataset. It can be applied to any iso- 

457 surface rendering view. For example, it can be directly combined 

458 with isosurface color enhancement such as the example given in 

459 Figure 7 (b). 

460 The other techniques mainly aim at the segmentation and recom- 

461 bination of the structures of interest. Figure 13 gives an example 

462 of seed picking and isosurface segmentation, which demonstrates 

463 how a tumor is segmented from a brain MRI image. Since the 

464 segmentation only works on the voxels containing the isosurface, 

465 the segmentation can be done very efficiently. In this example, the 
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Figure 11: Isosurface Color Enhancement Example, (a) Ordinary monotone isosurface rendering, (b) Full volume rendering, (c) Color 
enhanced isosurface rendering. The size of the images is 735x556. Rendering kernel execution times per-frame: (a) 6.0834 ms (b) 21.8971 
ms (c) 8.69162 ms 





(e) 



(f) 



Figure 12: Revealing internal structures. The pictures in the left 
column are rendered with full volume rendering(FVR) while the 
pictures in the right column are rendered with color enhanced iso- 
surface rendering (CEIR). (a)(b) The mouse data. (c)(d) The knee 
data. (e)(f) The head data. 



466 whole volume contains 256 x 256 x 124 = 8126464 voxels, but 474 

467 only 832869 nodes are involved in the min-cut optimization, which 475 

468 takes 8.25s to accomplish. If cropping is applied to restrict the re- 476 




Figure 13: Seed picking and isosurface segmentation, (a) Seed 
picking, (b) Isosurface segmentation. Volume size: 256 x 256 x 124 
Number of graph nodes: 832869 Segmentation computation time: 
8.25 s 




Figure 14: Seed picking and isosurface segmentation in a cropped 
region, (a) Seed picking, (b) Isosurface segmentation. Number of 
graph nodes: 40830 Segmentation computation time: 0.36s 



gion of interest, the computational cost can be made even smaller. 
As shown in Figure 14, in the cropped region, the number of graph 
nodes is reduced to 40830, and the computing time is reduced to 
0.36s. 

Another benefit of isosurface segmentation is that the accurate ray- 
isosurface intersection can be calculated during rendering. As a 
result, some staircase artifacts, which are usually seen in volume 
segmentation based rendering, can be avoided. As shown in Fig- 
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Figure 16: Abdominal-structure segmentation and visualization. 



Staircase *^^*^ L 

artifact jfl 



(a) 



(b) 



Figure 15: Visualization accuracy comparison of volume segmen- 
tation and isosurface segmentation, (a) Rendering a segmented vol- 
ume with linear boundary filtering, (b) Rendering a surface struc- 
ture produces by isosurface segmentation. 
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477 ure 15 (a), if volume segmentation is used, some staircase artifacts 

478 are very likely to be introduced even if linear boundary filtering is 

479 applied. These artifacts are not seen in Figure 15 (b), where the 

480 isosurface segmentation is used. 

481 In some applications like surgical planning, it is an essential task to 

482 extract structures of interests and to analysis the spatial relationship 

483 between them. Our explicit scene exploration provides a powerful 

484 tool to deal with these requirements. As shown in Figure 16, multi- 

485 pie organs are segmented and represented as the surface structures, 

486 then they are recombined into a single scene for rendering. 

487 7 Discussion 

488 Among all volume visualization techniques, isosurface rendering 

489 may be the most intuitive and efficient method. It is consistent with 

490 the most widely applied optical model used in b-rep graphics, which 

491 considers objects to have a solid silhouette, and the visual features 

492 mostly lie on the surface. This model faithfully depicts the objects 



in reality, and the rendering result has a realistic appearance. How- 
ever, for the same reason, people can argue that isosurface render- 
ing might not have sufficient functionalities for visualizing complex 
volume datasets. Our work shows that such point of view is very 
likely to be biased. First, its intuitiveness and simplicity are the ad- 
vantages for better computational performance which is critical in 
some interactive applications. Second, although it has some limita- 
tions, much can done to improve them and make isosurface render- 
ing more effective. In this work, we presented a series of techniques 
to enhance the effectiveness of the isosurface rendering, and make 
it a more powerful tool suitable for more application scenarios. 

To bring more information into isosurface visualization, we pro- 
pose the color enhanced isosurface rendering. Using this method, 
the color of isosurface is no longer monotone. It can be consid- 
ered that the isosurface is painted with a texture, which is generated 
according the neighborhood density, in order to reveal the internal 
structures of the volume data. As such, the representative power of 
isosurface rendering is very much extended. At the same time, its 
theoretical groundings can be traced to the full volume rendering. 

The explicit scene exploration further extends isosurface rendering 
by allowing physically meaningful structures to be extracted from 
different isosurfaces. In contrast to direct volume segmentation, the 
isosurface segmentation method can be more seamlessly integrated 
to an isosurface rendering system. However, since the extracted sur- 
face is not guaranteed to be closed, it can't be used to replace vol- 
ume segmentation. Despite of this, we hope to extend the segmen- 
tation method to volume segmentation by closing the cuts generated 
in the segmentation. In this way, the applications of the technique 
may be extended to requirements other than visualization, such as 
automated structure analysis. 
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